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(54) METHOD AND DEVICE FOR CORRECTING IMAGE DISTORTION 

(57)Abstract: 

PROBLEM TO BE SOLVED: To correct the distortion of 
an image to be picked up by extracting lattice point 
coordinates from an image, calculating a coordinate 
trausformation expression by using the coordinate 
points, and using the coordinate transformation 
expression. 

SOLUTION: The image obtained by expanding a lattice 
pattern in the same shape with the tetragonal lattice 
pattern stuck on the image to be picked up in parallel to 
a camera image pickup surface without varying the 
distance to the camera is inputted to a camera input 
part 2 and sent to a lattice point coordinate extraction 
part 4, which extracts all lattice point coordinates. After 
all the lattice point coordinates of each image are 
extracted, the coordinate data are sent to an image 
transformation expression arithmetic part 5 to calculates 
the transformation expression for the coordinates, which 
is sent to a coordinate transformation arithmetic part 6. 
The transformation coordinate arithmetic part 6 

transforms the coordinates of the source image by using the calculated transforms expression 
and an image data coordinate transforms part 7 reads the image stored in an image data 
storage part 3 and writes image data to the coordinates after transformation. Then, the image 
data of the source image are written to the coordinates after transformation and then an image 
data interrelating process part 8 interpolate data at a part where the image data is absent. 
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* NOTICES * 

JPO and NCI PI are not responsible for any 
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1 This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2.**** shows the word which can not be translated. 
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CLAIMS 



[Claim(s)] 

[Claim 1] A thing without the computer-aided-design (CAD) data of the three dimension of an 
image pick-up object, Or the image distorted by the curved surface on the front face of a 
metallic material which deformed into the form which differs from CAD data by thermal stress, 
an impact, etc. and three-dimension configuration like irregularity, or the image pick-up system 
is set to the distorted amendment approach of the image at the time of developing at a flat 
surface. A lattice point coordinate is extracted from both the images of the image picturized 
where the image which stuck and photoed the tetragonal lattice pattern to the image pick-up 
object, the tetragonal lattice pattern stuck on the image pick-up object, and an isomorphism-like 
grid pattern are developed to a camera image pick-up side and parallel, without changing 
distance with a camera. The image distorted amendment approach characterized by computing a 
coordinate transformation equation using the coordinate point, and amending distortion of the 
image of an image pick-up object by the coordinate transformation equation. 
[Claim 2] In the distorted compensator of the image at the time of developing the image 
distorted by the curved surface on the front face of a metallic material which deformed into the 
form which differs from CAD data by the thing without the CAD data of an image pick-up object 
or thermal stress, an impact, etc. and three-dimension configuration like irregularity, or the image 
pick-up system at a flat surface By the coordinate transformation equation computed with a 
means to capture an image, a means to memorize the image data picturized with this means, a 
means to extract the lattice point coordinate of a tetragonal lattice pattern from the image 
picturized with this means, a means to calculate a coordinate transformation equation using the 
extracted lattice point coordinate, and this means The image distorted compensator which 
consists of a means to calculate the coordinate after conversion of a subject-copy image, a 
means to change the coordinate of a subject-copy image by the coordinate computed with this 
means, and a means to interpolate lack of image data. 

[Claim 3] The image distorted amendment approach of having used affine transformation for the 
coordinate transformation equation in the distorted amendment approach according to claim 1 . 
[Claim 4] The image distorted compensator which used affine transformation for a means to 
calculate a coordinate transformation equation in a distorted compensator according to claim 2. 
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DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] This invention relates to the approach and equipment which amend 
distortion by the three-dimension configuration or image pick-up system of the curved surface 
on the front face of a metallic material at the time of detecting surface discontinuity generated 
on metallic material front faces, such as elevatedHiemperature components of a gas turbine, 
such as a crack and a blemish, and irregularity at a flat surface. 
[0002] 

[Description of the Prior Art] Conventionally, projective transformation was carried out to the 
camera image pick-up side, using the CAD data of a distorted amendment object etc. as a 
distorted amendment technique of an image, when it is the image from which the image with 
distortion changed the tetragonal lattice, the location of the lattice point in an image is 
measured, it opted for conversion used as the basis of distortion in approximation, and it is 
amended. 
[0003] 

[Problem(s) to be Solved by the Invention] When it deforms into the form which differs from 
CAD data by the thing without the CAD data of the object of distorted amendment or thermal 
stress, an impact, etc., the geometric distorted amendment which uses CAD data becomes 
difficult. 

[0004] The purpose of this invention is to offer the approach and equipment which amend the 
distortion at the time of developing the body of a curved surface and a concavo-convex three- 
dimension configuration at a camera image pick-up flat surface geometrically, or distortion by 
the image pick-up system, even if there are no CAD data when a distorted amendment object 
deforms and it differs from CAD data and. 
[0005] 

[Means for Solving the Problem] In order to attain the above-mentioned purpose, two kinds of 
images of the image which picturized the image which stuck and picturized the tetragonal lattice 
pattern to the image pick-up object, the tetragonal lattice pattern stuck on the image pick-up 
object, and the isomorphism-like grid pattern in the condition of having developed to a camera 
image pick-up side and parallel, without changing distance with a camera are taken. A lattice 
point coordinate is extracted from both images, a coordinate transformation equation is 
computed using the coordinate point, and it is attained by amending distortion of the image of an 
image pick-up object by the coordinate transformation equation. 

[0006] That is, even if there are no CAD data etc. by sticking and photoing a tetragonal lattice 
pattern to an image pick-up object, the image in the condition of having projected the tetragonal 
lattice pattern on the object can be photoed. Moreover, the image picturized where the 
tetragonal lattice pattern and the isomorphism-like grid pattern which were stuck on the image 
pick-up object are developed to a camera image pick-up side and parallel, without changing 
distance with a camera can be taken, the formula of coordinate transformation can be created 
by extracting a lattice point coordinate from both images, and it is attained by amending 
distortion of the image of an image pick-up object by the created coordinate transformation 
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equation. 
[0007] 

[Embodiment of the Invention] One example of this invention is applied to metallic material 
surface crack detection equipment, and the example carried out to the image compensator for 
amending the distortion at the time of developing the curved-surface section and concave 
heights on the front face of a metallic material at a flat surface is explained using a drawing. 
Drawing 1 is the block diagram showing the hardware configuration of the image distorted 
compensator by this invention, and the camera input section 2, the image data storage section 3, 
the lattice point coordinate extract section 4, the image transformation type operation part 5, 
the conversion coordinate operation part 6, the image data coordinate transformation section 7, 
and the image data-interpolation processing section 8 constitute the image distorted 
compensator 1. 

[0008] An image distorted amendment flow is shown in drawin g 2 . The image picturized with the 
camera 2 is incorporated in the camera input section 2 (processing step 10), the image is 
transmitted to the lattice point coordinate extract section 4 and the image data storage section 
3, in the lattice point coordinate extract section 4, all lattice point coordinates are extracted 
(processing step 20), and the image pick-up image of the object which removed the tetragonal 
lattice pattern is stored in the image data storage section 3 (processing step 21). 
[0009] Next, the image in the condition of having developed the tetragonal lattice pattern and 
the isomorphism-like grid pattern which were stuck on the image pick-up object to a camera 
image pick-up side and parallel, without changing distance with a camera is captured in the 
camera input section 2 (processing step 30), the image is transmitted to the lattice point 
coordinate extract section 4, and all lattice point coordinates are extracted (processing step 40). 

[0010] The coordinate data is transmitted to the image transformation type operation part 5 
after extracting all the lattice point coordinates of each image, and transformation of a 
coordinate is computed (processing step 50) and it transmits to the conversion coordinate 
operation part 6. In the conversion coordinate operation part 6, the coordinate of a subject-copy 
image is changed using the transformation computed previously (processing step 60), and the 
image stored in the image data storage section 3 by the image data coordinate transformation 
section 7 is written in the coordinate after changing read in (processing step 70) and image data 
(processing step 80). After writing in the coordinate after changing the image data of a subject- 
copy image, the data of a part with which image data is missing in the image data-interpolation 
processing section 8 are interpolated (processing step 90), and processing is completed. 
[001 1] Hereafter, detailed explanation of each part is explained using drawin g 3 thru/or drawin g 5 
R> 5, (several 1 ), and (several 2). 
[0012] 

x-ax+by+c, y =dx+ey+h — (several 1) 

To an object : (x y) A tetragonal lattice pattern coordinate [ of the stuck image ] (x\ y): — 
coordinate a.b of the image which developed the tetragonal lattice pattern and the isomorphism- 
like grid pattern which were stuck on the object to a camera image pick-up side and parallel, c, d 
and e, and h:correction factor q1=dm1+en1+h p1=am1+bn1+c — p2=am2+bn2+c, q2=dm2+en2+h 
p3=am3+bn3+c, q3=dm3+en3+h — (several 2) 

(ml, n1), (m2, n2) : (m3, n3) The coordinate of the image which stuck the tetragonal lattice 
pattern on the object (p1, q1), Coordinate a.b of the image which developed a tetragonal-lattice 
pattern and an isomorphism-like grid pattern which were stuck on p2 and (q2):(p3, q3) object to 
a camera image-pick-up side and parallel, c, d, e, h: As shown in drawin g 3 , photo the image 
inputted into the correction factor camera input section 2. The image which stuck the tetragonal 
lattice pattern 10 on the object is picturized, and the image which removed the tetragonal lattice 
pattern after that is picturized. The tetragonal lattice pattern to stick doubles magnitude so that 
it may be in agreement with an object front face. The image in the condition of having developed 
the tetragonal lattice pattern 10 stuck on the image pick-up object in parallel with the camera 
image pick-up side 12, without changing distance with a camera 11 is picturized. However, a 
tetragonal lattice pattern uses what was stuck on the object, and an isomorphism-like thing. 
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[0013] The image data storage section 3 outputs the image which stores the image pick-up 
image of the object which removed the tetragonal lattice pattern, and is stored after coordinate 
transformation termination. 

[0014] In the lattice point coordinate extract section 4, a lattice point coordinate is extracted 
from both the images of the image picturized where the image which stuck and picturized the 
tetragonal lattice pattern to the object, the tetragonal lattice pattern stuck on the object, and an 
isomorphism-like grid pattern are developed to a camera image pick-up side and parallel, without 
changing distance with a camera. The extract approach of a grid coordinate point changes into a 
binarization image the image captured like drawin g 4 with a predetermined threshold, and 
extracts the coordinate of the lattice point of the image whole region by the method of 
superposition. The partial field near the lattice point is used as a template image 20 used for 
pattern matching. Moreover, when a good binarization image is obtained neither with a lighting 
condition nor the configuration of an object, the operator handling equipment uses how the 
mouse which accompanies the personal computer for control, a keyboard, etc. extract the 
coordinate of the lattice point manually. In the image transformation type operation part 5, the 
transformation of an image is computed using the coordinate of the lattice point extracted in the 
lattice point coordinate extract section 4. The coordinate (x y) of the image g which stuck and 
picturized the tetragonal lattice pattern to the object in the lattice point which makes a small 
triangle as the calculation approach of an image transformation type as shown in drawin g 5 , and 
which adjoined (ml, n1), It is referred to as (m2, n2), and (m3, n3), and the coordinate (x\ y') of 
the image f picturized where the tetragonal lattice pattern and the isomorphism-like grid pattern 
which were stuck on the object are developed to a camera image pick-up side and parallel, 
without changing distance with a camera is carried out to (p1, q1), (p2, q2), and (p3, q3). It can 
ask for the equation (several 1 ) of the linear transformation which maps these three points in the 
location which carried out distorted amendment by solving six equations of (several 2) about 
each correction factor (a, b, c, d, e, h). Distortion of the image surrounded by three points by this 
transformation can be amended, and distortion of the image whole region can be amended by 
repeating this actuation to the group of all the lattice points. 

[0015] The conversion coordinate operation part 6 is applied to the transformation computed by 
the image transformation type operation part 5 about all the pixels of an image, respectively, and 
searches for the coordinate after conversion. The judgment with each pixel applied to which 
transformation makes a triangle in quest of the straight line which connects the lattice point 
coordinate of three points, and judges it by whether it is in the inside of three straight lines, or it 
is outside. 

[0016] The image data coordinate transformation section 7 writes image data in another image 
memory based on the coordinate data after the conversion which asked for the image data 
stored from the image data storage section 3 by read in and the conversion coordinate operation 
part 6. 

[0017] By the body of a curved surface and a three-dimension configuration like irregularity, 
since the grid pattern of a part with distortion is smaller than the grid pattern of a part without 
distortion and information is compressed, the image data lack produced when coordinate 
transformation is carried out by the image data-interpolation processing section 8 is 
interpolated. 

[0018] From the image after the coordinate transformation surrounded first at the four lattice 
points, the approach of interpolation of image data searches for the coordinate of the part which 
lacks image data, and writes in image data using the about 5x5-pixel image data 3x3 pixels near 
the searched coordinate. In the case of this example, it is crack detection on the front face of a 
metallic material, and since a crack is distributed over the low gradation in 0 - 255 gradation, the 
image data to write in writes in the minimum brightness value of nearby image data. 
[0019] The crack distributed over the curved surface on the front face of a metallic material and 
a bent image like irregularity by the above-mentioned processing can be developed at a camera 
image pick-up flat surface. 
[0020] 

[Effect of the Invention] In the curved surface on the front face of a metallic material which 
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deformed into the form which differs from CAD data by the thing without the CAD data of an 
object or thermal stress, an impact, etc. according to this invention, and the image of a 
perverted three-dimension configuration like irregularity The image in the condition of having 
projected the tetragonal lattice pattern on the object even if there were no CAD data etc. by 
sticking and photoing a tetragonal lattice pattern to an object can be photoed. Moreover, the 
image picturized where the tetragonal lattice pattern and the isomorphism-like grid pattern which 
were stuck on the object are developed to a camera image pick-up side and parallel, without 
changing distance with a camera is taken. By extracting a lattice point coordinate from both 
images, the formula of coordinate transformation can be created and it becomes possible to 
amend distortion of the image of an image pick-up object by the created coordinate 
transformation equation. 



[Translation done.] 
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* NOTICES * 
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DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

[ Drawin g 1] The block diagram of the image distorted compensator which is the example of this 
invention. 

[ Drawin g 2] Drawing showing the image distorted amendment flow of drawin g 1 . 
[ Drawin g 3] The image Fig. by the image photography approach of this invention. 
[ Drawin g 4] The image Fig. by the extract approach of the grid coordinate point of this invention. 

[ Drawing 5] Drawing showing the lattice point used for the image transformation type creation 
time of this invention. 
[Description of Notations] 

1 [ — The lattice point coordinate extract section 5 / — Image transformation type operation 
part, 6 / — Conversion coordinate operation part, 7 / — The image data coordinate 
transformation section, 8 / — The image data-interpolation processing section, 10 / — A 
tetragonal lattice pattern, 11/ — A camera, 12 / — A camera image pick-up side, 20 / — 
Template image. ] — A distorted compensator, 2 — The camera input section, 3 — The image 
data storage section, 4 



[Translation done.] 
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DRAWINGS 



[ Drawin g 1] 
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